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(57) ABSTRACT 

An object-oriented computer environment having a pair of 
graphical objects displayed on a graphical window of a 
display screen. The graphical objects are positioned relative 
to one another in a desired orientation through the use of a 
user interface. The graphical objects are operatively joined 
at an anchor point so that movement of one of the graphical 
objects will correspondingly move the other graphical object 
joined therewith. 

20 Claims, 12 Drawing Sheets 
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METHOD AND APPARATUS FOR JOINING 
AND MANIPULATING GRAPHICAL 
OBJECTS IN A GRAPHICAL USER 
INTERFACE 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to computer sys- 
tems having a graphical user interface. More particularly, the 
invention pertains to a method and apparatus for defining 
and connecting graphical objects to one another in an object 
oriented computing environment. 

2. Description of the Prior Art 

Graphical user interfaces employing an object-oriented 
programming paradigm are commonly used in application 
programs such as word processing and database programs, 
as well as other graphic desktop applications. A graphical 
user interface provides manipulable graphical objects such 
as icons, windows, and various controls that can be used to 
control underlying software or hardware represented by the 
graphical objects. Typically, a user interacts with the graphi- 
cal user interface using a graphical pointer that is controlled 
by a pointing device, such as a mouse or trackball, to 
accomplish conventional drag and drop techniques and other 
graphical object manipulations. 

The conventional object-oriented, graphical user interface 
provides an effective manner to monitor and control under- 
lying components represented by the graphical objects. 
However, applications that display animation or graphical 
movement between connected components have required 
the assistance of computer programmers and specially 
designed custom software. Examples of such applications 
are computer simulation programs, mechanical emulation 
programs, and user display or control applications that 
graphically display moving components of an automated 
process. Accordingly, these programs are typically difficult 
and expensive to develop making them generally unavail- 
able to many industries and possible applications. 

As will be described in greater detail hereinafter, the 
method and apparatus of the present invention solves the 
aforementioned problems by employing an object oriented 
paradigm to represent connectable graphical objects and 
employs a number of novel features that render it highly 
advantageous over the prior art. 

SUMMARY OF THE INVENTION 

Accordingly, it is an object of this invention to provide a 
system and method for connecting and manipulating graphi- 
cal objects. 

Another object of this invention is to provide an improved 
graphical user interface in a computer system for displaying 
or monitoring graphical objects. 

Still another object of this invention is to provide object 
dragging and dropping techniques for connecting graphical 
objects. 

Yet another object of this invention is to provide a method 
and apparatus which can be easily used by systems engi- 
neers or designers to provide applications having graphical 
objects virtually connected to one another in a graphical 
computing environment without having to rely upon the 
assistance of computer programmers and specially designed 
custom software. 

To achieve the foregoing and other objectives, and in 
accordance with the purposes of the present invention a 
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method and apparatus of operatively joining graphical 
objects are provided. The graphical objects are displayed on 
a computer display device of a computer system which 
includes the display device, a processor, and memory for 

5 storing the graphical objects. 

At least two graphical objects are connected or anchored 
to one another such that movement of a representation of one 
of the graphical objects on the display device correspond- 
ingly affects the movement of a representation of the other 

10 graphical object. In use, the representation of one of the 
graphical objects will be moved on the display device in 
response to a value change of a property of that graphical 
object, where that property is associated with the positioning 
of the representation of that graphical object on the display 

is device. The representation of any connected graphical object 
joined therewith will then move automatically so that the 
representations of the graphical objects preferably emulate a 
mechanical connection. 

In accordance with an aspect of the invention, the graphi- 

20 cal objects are displayed by dragging representations of the 
graphical objects in response to position commands from a 
user interface coupled with the computer system to position 
the representations in a desired orientation relative to one 
another. Each graphical object is connected to another at an 

25 anchor point that can also serve as a pivot point to move the 
graphical object pivo tally about the other. 

Other objects, features and advantages of the invention 
will become more readily apparent upon reference to the 
following description when taken in conjunction with the 
accompanying drawings, which drawings illustrate several 
embodiments of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 In the drawings: 

FIG. 1 depicts an exemplary computer system configured 
according to the teachings of the present invention; 

FIG. 2 is a block diagram of one preferred container 
application according to the teachings of the present inven- 
40 lion; 

FIG. 3 is a block diagram of the container application 
depicting its hierarchical structure; 

FIG. 4 depicts a grouping function for objects; 
FIG. 5 depicts a preferred embodiment of a graphical 
45 object; 

FIG. 6 is a flow diagram of graphical object processing; 

FIG. 7 depicts persistence of the objects according to the 
teachings of the present invention; 
50 FIG. 8 is a block diagram of one preferred embodiment of 
server communication; 

FIG. 9 is an exemplary embodiment of a communication 
network connected with remote devices; 

FIG. 10 is a flow diagram of one preferred embodiment of 
55 data transmission through the server; and 

FIGS. 11-15 depict graphical interface screens of a pre- 
ferred embodiment according to the teachings of the present 
invention. 

60 DETAILED DESCRIPTION OF THE 

PREFERRED EMBODIMENT 

The present invention generally relates to joining and 
manipulating graphical objects, as later described, on a 
computer display screen. The invention may be run on a 
65 variety of computers or computing systems including per- 
sonal computers, mainframe systems, and distributed com- 
puting environments. 
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In the following description, numerous specific details are be obtained from "Inside Visual C++" by David J. 

set forth in order to provide a thorough understanding of the Kruglinski, 1996, Microsoft Press, and "Inside OLE T by 

present invention. It will be obvious, however, to one skilled Kraig Brockschmidt, 1994, Microsoft Press, both of which 

in the art that the present invention may be practiced without are hereby incorporated by reference, 

many of these specific details In other instances well- 5 Rcferring to FIG. 2, the application 24 in a preferred 

known structures, circuits, and programming techniques . A . , . ' . ^ . p . " 

k« M « rt » k»« e t,«,« in <i -i • a 'i embodiment is a container application written in C++ 

have not been shown in detail in order not to unnecessarily , , r iL « < • 1 , , , 

obscure the present invention. capablc of mana S m 8 ^ graphical objects described below. 

D a f a ^ nrt * A nr i * 1A c The container application 24 includes a server application or 

Referring to HO. 1, a computer system 10 of an exem- , t , AA f\ iL , 4 eAl _ {T , , . 

«i.«,*mk«^i m «i ft f.i. 4 . • • i i . data addin 44 that manages the data of the graphical obiects 

plary embodiment of the present invention includes a system nn « . , ... AJjJ -? « * n_ A- \ ■ w 

i-> tv^ c1 ,rf ftfM n • i j , . . 10 as later described. Additionally, toolbar addins 46, ActiveX 

unit 12. I tie system unit 12 includes a system bus 14 to . ^ ao j x** r* w- in a . 

„,h^K ™™~^ 0 «t„ ♦ ^ a • ♦ controls 48, and Microsoft Visual Basic Application (MS 

which various components are connected and communicate * m a\ «» n * u- u i • iL _r <• 

+u \>f,v i.™^ i £ * a , a. * u VBA) 50, all of which are known in the art, are preferably 

through. Microprocessor 16 is connected to the system bus J \ , . . tU .. -J 

+ A *~ > iU /nA ,A 1fi ; , , incorporated into the contamer application 24 to provide 

14 along with random access memory (RAM) 18 and read , - ... L1 t y c F 

i„ m „ mn „, /daxa in tl \r u additional functionality, usable tools or ease or programma- 

only memory (HUM) 20. The Microprocessor can be any u , T( Ti . . /' , 4 . , , 

„ rtf ' i M i j • j » y j , TirxT 35 bihty. It is significant to note that various exemplary and 

number ot conventional processors including the Intel PEN- / , r <• c iL . • • •„ , 

tti Txyf Tmvx nnu;cDDP • preferred embodiments of the present invention will be 

T1UM microprocessors, IBM POWERPC microprocessors, \ -u ^ u *u ^ . . • ^ t_ 

or others described by the C++ programming language, however one 

„ n '. fi0 . . f . . * skilled in the art would appreciate that other object models 

, h ^™ ^, , 15 n main | TT mn h c and techni ^<* «ui be defined using other programming 

the ROM 20 typically includes the BIOS and other basic 2 o languages 
operating instructions, data and objects used by the system 

12 to perform its functions. The operating system 22 and Graphical Objects 
application program 24, when loaded into the system 12, are 

typically retained within the RAM 18, though portions may Referring to FIG. 3, the hierarchy structure of the con- 
be retained on the disk drive or storage medium 26, such as 15 tainer application 24 is represented. Graphical objects 52 are 
a hard disk drive or CD ROM. One skilled in the art would placed on a graphical page 54, where the page 54 is part of 
appreciate that the storage of application programs may a document 56. In some cases the page is the document, or 
extend over various mediums and that during run time it is there is no distinction between a document and the pages in 
not uncommon that an application program or portions me document. 

thereof may be residing in several mediums at once or may 30 Referring to FIG. 4, page 54 of the container application 
even be distributed across a network in several different comprises a data structure CDRAWOBJ. All primitives, 
systems. The keyboard controller 28, pointer or mouse such as text, rectangles, arcs, ellipses, polygons, and graphi- 
controller 30 and video controller 32 are connected to the cal objects are derived from CDRAWOBJ. For illustrative 
system bus 14 and provide hardware control and intercon- purposes, page 54 includes a rectangle 58, ellipse 60, and 
nection for the keyboard 34, pointer or mouse 36, and 35 graphic 62. As a data structure, each are represented as 
graphic display 38 which are connected to respective con- CDRAWOBJ. When performing a group function 61 on any 
trollers. The graphic display 38 has a display screen 39 for number of CDRAWOBJs a new CDRAWOBJ is thereby 
displaying representations of graphical objects thereon. For defined as a group having children defined by the selected 
discussion purposes herein, it should be understood that group items. Window 63 illustrates CDRAWOBJs 58, 60 
reference to displaying a particular graphical object refers to 40 being grouped into CDRAWOBJ Group 2, shown in window 
displaying a graphic representation of the graphical object 65, having rectangle 58 and ellipse 60 as children. Further 
and discussion of same may be used interchangeably. I/O groups of still other groups can be grouped to create CDRA- 
module or interface 40 is connected to the system bus 14 and WOBJs that could include hundreds or any desired number 
enables communication over a network 42, as described of primitives. It should be understood that windows 63, 65 
later in more detail, 45 are for illustrative purposes to depict the grouping function 
The pointer or mouse 36 can be any type of pointing and do not correspond to visual or graphical display win- 
device including, for example, a mouse, trackball, or touch- dows. 

sensitive pad. The pointer or mouse 36 is well known in the Once grouped, a graphical object is formed. It should be 

art and is used by a user to generate control signals having noted that the graphical objects will also be referred to 

two or more dimensions. The control signals are transmitted 50 herein simply as objects. A graphical object is typically a 

to the microprocessor 16. For example, movement of the collection of object primitives. Whatever happens to a 

mouse 36 across a surface will generate control signals in an graphical object or parent graphical object, as a group, 

x-axis and y-axis. The mouse 36 further includes one or occurs to all its children. In the preferred embodiment, each 

more buttons or actuators that can be selectively actuated by graphical object is defined as follows: 

the user to generate further control signals to the micropro- 55 
cessor 16. The use of the mouse or similar pointer device is 

described later with respect to the features of dragging and 

dropping of graphical objects displayed on the display 38, CDrawObj 

The implementation of dragging and dropping in a windows CTbttobj 

graphical environment by using the control signals gener- 60 CPciyObj 

ated by the mouse is well known in the art. CProgrammable 

Object oriented programming paradigms and characteris- ca'^xS' 3 

tics relating to encapsulation, inheritance, and polymor- ____ 

phism are well known in the computer programming arts. 

Accordingly, for brevity, various conventional techniques 65 The CRectObj is an object defining a rectangle. The 

and terminology have been omitted. Further information and CTextObj is an object defining a text-based box or window 

details about these subjects, as well as C++ and OLE, may and CPolyObj is an object defining a polygon type shape. 
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The CRectObj, CTextObj and CPolyObj are configured optional numeric expression specifying distance. The 

similarly to those corresponding objects that one would find AnchorX property is expressed in twips. If the AnchorX 

independently in Windows C++ programming or through the value is positive, the anchor point is set to the right of the 

use of MS VBA. object's center point. If the AnchorX value is negative, the 

CProgrammable is an object that includes anchor, spin, s anchor point is set to the left of the object's center point. If 

and rotation attributes to the CDrawObj and will be the object is spun or rotated, or its anchor is moved, the 

described later in more detail. CProgrammable includes AnchorX value of the object changes accordingly. 

CComplexOBj which is an array of CDrawObjs that pro- The AnchorY property specifies the vertical distance 

vides the ability and complexity of allowing the CDrawObj between the center of the object and its anchor point. Its 

to be comprised of other CDrawObjs or groups thereof. The 10 exemplary syntax is shown as: 

functionality of CProgrammable with respect to anchor, spin Object. AnchorY [=double] 

or rotation is an important part of the present invention. In where the Object is a required portion corresponding to the 

another embodiment, for example, the CDrawObj graphical graphical object being evaluated and the double portion is an 

object could comprise only one or more of these CProgram- optional numeric expression specifying distance. The 

mable elements without the other text or geometric based 15 AnchorY property is expressed in twips. If the AnchorY 

objects. value is positive, the anchor point is set below the object's 

Graphical Object Properties centcr P oint ' If the A™*™* value 15 negative, the anchor 

point is set above the object's center point. If the object is 

Each graphical object 52 includes properties 64 and may spun or rotated, or its anchor is moved, the AnchorX value 

also include methods 66, as represented in FIG. 5. The 0 f the object changes accordingly. 

functionality of the Anchor, AnchorLock, The Rotation property specifies the degree of rotation of 

AnchorLockAutoReturn, AnchorX, AnchorY, Rotation, an object around its center. Its exemplary syntax is shown as: 

RotationX and RotationY properties serve an important role Object Rotation [=double] 

in one preferred embodiment of the present invention where where the 05ject fe a required portion correspondirig t0 the 

the application of same is used for mechanical emulation graphical object being evaluated and the double portion is an 

purposes later described. In alternative embodiments, one or optional numeric expression specifying degree of angle. In 

more of these properties will be provided to serve the a preferred embodiment, the value of the Rotation property 

emulation or movement characteristics of a particular appli- can only be ^ dllring runtime The Rotation property is 

cation. The functionality of these properties 64, along with expressed in twips and the value of this property changes as 

an exemplary syntax are described below. 3o the object ^ moved left or right by the user or by code 

The Anchor property specifies the angle, in degrees, that Preferably, this value is in the range of 0 to 360 degrees, 

an object can move relative to its anchor point. Its exemplary The RotationX property specifies the distance between the 

syntax is shown as: center of the object and its rotation point. Its exemplary 

Object. Anchor [^double] syntax is shown as: 

where the Object is a required portion corresponding to the 35 Object.RotationX [^double] 

graphical object being evaluated and the double portion is an where the object is a required portion corresponding to the 

optional numeric value expressing degrees. Preferably, this graphical object being evaluated and the double portion is an 

value is in the range of 0 to 360 degrees. optional numeric expression specifying distance. The Rota- 

The AnchorLock property specifies whether the anchored uorJ x property is expressed in twips. If the RotationX value 

object maintains its original angle while rotating with its 40 is positive, the rotation point is set to the right of the object^ 

parent object. Its exemplary syntax is shown as: center pomt . if the RotationX value is negative, the rotation 

ObjecLAnchorLock [-boolean] point is set to the left of the object's center point. If the 

where the Object is a required portion corresponding to the object is spun or rotated, or its rotation point is moved, the 

graphical object being evaluated and the boolean portion is RotationX value of the object changes accordingly, 

an optional boolean expression that specifies whether to lock 45 The RotationY property specifies the distance between the 

an anchor point. With the setting of the boolean to true, the center of the object and its rotation point. Its exemplar}' 

anchored object's angle changes relative to its parent object. syntax is shown as: 

With the setting of the boolean to false, the anchored object Object.RotationY [=double] 

maintains its original angle as it rotates with its parent wne re the Object is a required portion corresponding to the 

°bj ect ' 50 graphical object being evaluated and the double portion is an 

The AnchorLockAutoReturn property returns the value of optional numeric expression specifying distance. The Rota- 

the Anchor property to its original design value. Its exem- tionY property is expressed in twips. If the RotationY value 

plary syntax is shown as: is positive, the rotation point is below the object's center 

Object.AnchorLockAutoReturn [-boolean] point. If the RotationY value is negative, the rotation point 

where the Object is a required portion corresponding to the 55 is set above the object's center, point. If the object is spun 

graphical object being evaluated and the boolean portion is or rotated, or its rotation point is moved, the RotationY value 

an optional boolean expression that specifies whether to of the object changes accordingly. 

reset the original value of the Anchor property. With the To add further functionality, a graphic object may also 

setting of the boolean to true, the anchor point position is include any of the additional properties as follows: 

reset to its original value. With the setting of the boolean to 60 BackColor( ) as Color, returns or sets the background color 

false, the anchor point position remains at its current value. of a graphic; ForeColor( ) as Color, returns or sets the 

The AnchorX property specifies the horizontal distance foreground color of a graphic; Height( ) as Double, returns 

between the center of the object and its anchor point. Its or sets the dimensions of a graphic; HsliderEnd( ) as Double, 

exemplary syntax is shown as: returns or sets the horizontal end position of a graphics slider 

Object. AnchorX [-double] 65 of the type known in the art; HsliderEndValue( ) as Double, 

where the Object is a required portion corresponding to the returns or sets the maximum value of the graphics slider; 

graphical object being evaluated and the double portion is an HsliderMouseEnabled( ) as Boolean, returns or sets a value 



09/15/2004, EAST Version: 1.4.1 



US 6,559,860 Bl 

7 8 

indicating whether the graphics slider is enabled; The olNonRigidParents provides a list of items that are 

HsliderStart( ) as Double, returns or sets the horizontal start connected to an object where the AnchorLock property is 

position of the graphics slider; HsliderStartValue( ) as turned off. The data structure olSelection provides the list of 

Double, returns or sets the minimum value of the graphics attached objects in the exemplary embodiment. Referring to 

slider; HsliderSteps( ) as Double, returns or sets the amount 5 piG $ AddAnchorPartner s is the method, starting at step 

of change to the HsuderValue property setUng when the user olSelection list, which is depicted at step 70. 

clicks the area between the scroll graphic and the Hshder- " . . Ul * v ™ . . , . . , . , . 

End property; HsliderValue( ) as Double, returns or sets the ™* ^ 15 creatcd b V ^viewing the anchonng relationship 

current position of the scroll bar, whose return value is defined in each object m relationship to the object being 

between the values for the HsliderEndValue and Hslider- 10 acted on. 

StartValue properties; L*ft( ) as Double returns or sets the ^ ^ olSelection can be built as follows: 
distance between the internal left edge of a graphical object 
and the left edge of its container; Spin( ) as Double, returns 

or sets the rotation angle from the center of the graphical 

object; Top( ) as Double, returns or sets the distance between is CDrawObjList olsclection; 

the internal top edge of a graphic and the top edge of its olSelection. AddT&il (this); 

container; Visible( ) as Boolean; returns or sets a value AddAnchorPartners (olSelectkm); 

indicating whether a graphical object is visible or hidden; 

VsliderEnd( ) as Double, returns or sets the vertical end _ A , ^ „ 

position of the graphics slider, VsliderEndValue( ) as 20 The AddTaii function used above adds a new object into 

Double, returns or sets the maximum vertical value of the a collection at the end of the list. In the preferred embodi- 

graphics slider; VsliderMouseEnabled( ) as Boolean, returns ment described herein, rigid partners refers to two objects 

or sets a value indicating whether the graphics slider is anchored together. The one object that is anchored to another 

enabled; VsliderStart( ) as Double, returns or sets the has its AnchorLock flag set to True. If the AnchorLock 

vertical start position of the graphics slider; 25 property of an object is set to True, then it is considered 

VsliderStartValue( ) as Double, returns or sets the minimum rigid. If it is set to False, it is considered nonridig. Movement 

vertical value of the graphics slider; VsliderSteps( ) as of rigid and nonrigid objects with respect to the AnchorLock 

Double, returns or sets the amount of change to the Vslider- property occurs differently as will be described later in 

Value property setting when the user clicks the area between further detail, 

the scroll graphic and the VsliderEnd property; 30 

VsliderVaue( ) as Double, returns or sets the current posi- To find *e ob J ects anchored to a particular object at step 

tion of the scroll bar, whose return value is between the 72 > depicted below is C++ pseudocode illustrating an 

values for the VsliderEndValue and VsliderStartValue prop- example thereof, 
erties; and Width( ) as Double, returns or sets the dimensions 

of a graphical object. 35 

Anchor Partners * f( ^-P^™ && ObChildrenOnly) ) 

A graphical object may be composed of several other j f (olNonRigidPareiits==NULL) 

objects anchored together. When one of the several other % ( !o is e ie C tion.Find(m_pAnchorib) ) 

objects is rotated or moved, it is necessary to execute a 40 { 

process in which the other connected objects are informed of // not in selection 

the move and are also moved in accordance with the manner ^Itcho^ 

of connection. In a preferred embodiment, this functionality b chiidrenOnly, olNo^R^Parente)^ ^ ° rFartnerS ( ° & eCtl ° n ' 

is achieved by a process that scans all aspects of the } 

connections of an object to form a collection. Whenever an 45 } else 

action is performed on one part or child of a parent object, { qq1 add rf ^ ob . ect 

that same action is broadcast through the collection of if (^bAnchorLoci) 0 

objects that make up that one object. In the preferred { 

embodiment illustrated in FIG. 6, a method referred to if ( !oiSeiection.Find(m^.pAnchorTo) ) 

herein as AddAnchorPartners performs this function to 50 t ^ ^ selection et 

quickly find all aspects of the relationships to construct the ol&le^olSma(m_pAiicho/ib); 

action collection. Using C++ pseudocode, the method defi- m_pAnchorTo-> 

nition of AddAnchorPartners is depicted below. AddAnchorPartners (olSelection, bChildrenOnly, olNonRigidParents); 

55 } eUe 

^ — — — — ^ rigid! just collect 

vo^CFrogrammable::AddAnchorPartnersCCDrawObjlist& olSelection, if ( !olNonRigidP a rent S ->Find(m_pAnchorTo) ) 



{ 



bChiJdrenOnly, CDrawObjList- olNonRigidParents ) ^ olNonRi S idPareQts->AddT a ilCm_pAnchorIb); 



60 



} 



It should be understood that all of the C++ pseudocode } 

examples herein could be written in other languages. } 

Further, in the programming arts there are numerous ways 

that the functionality of object anchoring could be 

implemented, such as by using different data structures, 65 To find the objects anchored from a particular object at 

alternative object linking procedures, lookup tables or linked step 74, depicted below is C++ pseudocode illustrating an 

lists. example thereof. 
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// check for children 

int cnt = m_arAncriorFrom.GctSize ( ) t 

for (int i«=0; i<cnt; i++) 

{ 

if (olNonRigidParents==NULL) 
{ 

// traditional implementation, collect everything 
tf ( !olSelection.Find(ro_arAnchoiFrom[iD ) 
{ 

// not in selection yet 
ol Selection. Add1^il(m_arAnchorFrom(i]); 
m_ar A ncho rFrom[ ij- > 
AddAnchorPartners(olSelection, bChildrenOnly, olNonRigidParents); 
} 

} else 
{ 

// only add rigid children 

if (m_arAncho rFro m[i]- >m_b Anchor Lock) 

if ( !olSelection.Find(rn__arAnchorForm[i]) ) 

{ 

// not in selection yet 

olSelection. AdaTati(m_arAiichorFrom[ i]) ; 
m_arAnchorFrom[i)-> 
AddAnchorPartners(olSelection, bChildrenOnly, olNonRigidParents); 
} 

} else 
{ 

// not rigid! just collect 

if( !olNonRigidParents->Find(m_arAnchorFrom[i]) 
{ 

olNonRigidParents- > 

AddTail (m arAnchorFrom[i]); 

} 

} 

} 

} 

} 



In the user interface described later, when a user links two 
objects, the user will, have selected a first object and a 
second object. After actuating the linking or anchoring 
process, the first object's m_pAnchorTo is set with the 
second object, and the first object is added to the second 
object's m__arAnchrorFrom collection. It should be appre- 
ciated that any number of objects could be anchored to one 
particular item. Accordingly, it should be understood that in 
the foregoing pseudocode that m__arAnchorFrom[i] refers 
to the i'th object in the collection. 

As previously discussed, once the connection tree is 
stored in a collection, the appropriate operations or move- 
ments on the sub-parts or objects of a complex object can be 
performed. Through the use of recursion, the ability to reach 
the finite atomic object is accomplished. When moving an 
object, as described later in further detail, all the objects 
anchored to it are moved accordingly. 

In one preferred embodiment, before performing opera- 
tions on these objects, the initial design state of the objects 
is saved at step 76. When an object is rotated, its true shape 
or definition is lost over time by the action performed on it 
due to mathematical round-off. To speed up operations when 
a screen is repainting, the information that makes up a shape 
is transformed, but its initial design state is saved so that the 
object will not lose its true appearance as numerous opera- 
tions are performed on it. This step is depicted below in C++ 
pseudocode. 



pos « olSclcction.GctHeadPositionf ); 
while (pos) 

5 { 

pC = (CProgrammable*) olSelcctioaOetNext(pos); 

if( !pC->rru_bWasDesignStateSaved) 

{ 

pC->SaveDesignstate{ ); 
pC->m_bWasDesignStateSaved - TRUE; 

10 } 
} 



After the design state has been saved, various rotate, spin, 
and movement functions can be performed to the objects at 

15 step 78. The application of these motion functions by 
themselves for a single unconnected object is known in the 
art. However, any such movement of an object of the present 
invention will then require corresponding movement to 
anchored objects. This is achieved by utilizing the anchor 

20 partner functionality previously described so that the move- 
ment is broadcast to each anchored object for effectuating a 
movement that corresponds to the connection therebetween. 
For example, when an object spins, its position will also 
move. Accordingly, a calculation of how the object has 

25 moved is made and all objects attached to this object are 
oflset by the calculated number of pixels. 

In summary, one embodiment of the foregoing method of 
manipulating and displaying graphical objects on the com- 
puter display device of the system includes the step of first 

30 creating a graphical object in an object-oriented environ- 
ment and storing the graphical object in the memory of the 
computer system. The graphical object may be comprised of 
a plurality of child graphical objects where the graphical 
object and each of the child graphical objects has at least one 

35 property corresponding to the orientation of a representation 
of the respective graphical object, such as the Anchor 
property. Next, the graphical object is scanned by traversing 
through each of the child graphical objects to form a 
connection tree having initial values of each properly of the 

40 respective graphical objects. The connection tree being 
preferably stored in the memory of the system. In operation, 
a value of the property of the graphical object will become 
altered from the initial value which corresponds to a change 
in the position of the representation of the graphical object. 

45 The representation of the graphical object will be graphi- 
cally displayed on the display device by traversing through 
the connection tree to broadcast the altered value of the 
graphical object to each of the child graphical objects, 
recalculating the value of each property of the child grapbi- 

50 cal objects based on its initial value and the altered value of 
the graphical object, and displaying the representation of the 
graphical object including its child graphical objects on the 
display device with the recalculated values. 

55 Persistence 

During operation of the system as previously described, it 
will be appreciated that the various graphical objects created 
will change positions relative to one another. When ending 
a presently running program or application, the graphical 

60 objects and the values of their present properties can be 
retained in the conventional manner of saving the various 
information to disk. However, the data structures of the 
graphical objects include linked lists. The pointers of these 
linked lists existing at the time the application or program is 

65 running are not saved to disk. Without this information, 
objects later reloaded and reassembled would not have the 
proper orientation of their graphical representations. 
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In a preferred embodiment illustrated in FIG. 7, persis- 
tence 80 is accomplished by creating a Z-order property of 
a graphical object. Persistence refers to the permanence of 
an object, that is, the amount of time for which it is allocated 
space and remains accessible in the system's memory. When 5 
the object is reloaded, individual segments of the object are 
reassembled accordingly. At step 82, a Z-order array 81 is 
created and stored in memory 18. When the present state of 
the graphical objects are to be retained, each graphical object 
is traversed at step 84 and is provided at step 86 with an 10 
indexing number. At step 88, the numbers are saved in the 
Z-order array 81 which provide the numerical index based 
on the Z-order. At step 90, the Z-order array 81 is stored to 
disk drive 26 or other storage medium. 

15 

Server and Networking 

The server or data addin 44 is in communication with the 
network 42 (FIG. 1) to read and write data across the 
network 42 to a particular node, which may be another 
device, processor, etc. Further, the server moves the data into 20 
the container application to update particular variables with 
new or changed values. The server 44 can be a separate 
application or interface coupled with the container applica- 
tion internally or remotely. Alternatively, the two applica- 
tions could be integrated together. As later described, the 25 
server in one embodiment updates the values in the Anchor 
or Rotation properties to provide mechanical emulation. 

In one embodiment shown in FIG. 8, the server commu- 
nicates through Dynamic Data Exchange (DDE) and main- 30 
tains the connection with the communication network. The 
server uses DDE request strings 92 to access information. 
The DDE request string, graphically depicted in FIG. 8, is 
formed of three elements including the application 94, topic 
96, and item 98. The application 94 identifies the source of 35 
the request. The topic 96 identifies the device to be com- 
municated with and the item 98 is the name of the particular 
address for which a value is to be returned. For example, a 
DDE request having an application name DDESERVER, a 
topic name PLCS, and an item C5:0. ACC, corresponds to 4Q 
returning the value stored in address C5:0. ACC of PLCS 
100 to the server DDESERVER 44'. 

It should be appreciated that the server could be config- 
ured in a number of manners. The server could include a 
separate processor operating remote from the container 45 
application with the information being transferred across the 
communication lines. Additionally, the server could be soft- 
ware based, such as RSLinx™ produced by Rockwell 
Software, Inc. of West Allis, Wis., installed within the same 
computing device that is operating the container application 50 
along with an associated I/O module or card of conventional 
type. As a further example, the server could be an OLE for 
Process Control (OPC™) server which provides a standard- 
ized mechanism to provide data from a data source, com- 
municate the data to an application, and update the data 55 
therebetween. 

An exemplary communication network of conventional 
design is implemented herein. The choice of network will be 
typically based on the type of system application. In FIG. 9, 
a ControlNet™ network, produced by the Allen-Bradley 60 
Company, LLC of Milwaukee, Wis. is illustrated. The Con- 
trolNet™ network meets the demands of real-time, high- 
throughput applications and is well-suited for industrial 
automation applications where the network will be linked to 
PLC processors, I/O, computers, and other devices or net- 65 
works. For example, in this exemplary embodiment, the 
network 42, such as the ControlNet™ network, is connected 



,860 Bl 

12 

with other computer systems 10 or programmable logic 
controllers 102. The network 42 may be directly connected 
with an automation system or device 104 or may be further 
connected to another network 106 or system. Shown in the 
FIG. 9, the network 106 is DeviceNet™ Network, produced 
by the Allen-Bradley Company, LLC of Milwaukee, Wis. 
Tlie network 106 is connected to network 42 through line 
109 in the embodiment shown here. The network 106 is 
connected with various devices which may include a 
machine or robotic device 108, valve 110, motor 112, sensor 
114, or other devices or components 116. It should be 
understood that the particular configuration will vary 
depending on the application. 

In an industrial automation or other time-sensitive 
applications, the representations or graphical images of the 
graphical objects are updated in substantially real-time to 
reflect the changes in position attributes which are repre- 
sented as values of particular variables. Referring to FIG. 10, 
the server operates independently from the container appli- 
cation to maintain communication with the network and to 
update any changed values of the properties, as previously 
discussed. At step 120, the server operates with a conven- 
tional interface technique, such as one operating through 
DDE, OPC™ or Component Object Model (COM) inter- 
face. At the step 122, the interface monitors the condition of 
the variable to detect a change. If a change occurs, the server 
will receive the new value of the variable at step 124. If at 
step 126 the value is to be manipulated for any purpose, then 
such action occurs at step 128 by executing code residing in 
a corresponding graphical object in the form of an event that 
is triggered. For example, the value as received from the 
server may exist in raw data form that must be processed by 
the event. Id other cases, the value may need to be properly 
scaled for use in the parameter range that has been.previ- 
ously set for the corresponding property. At step 130, the 
corresponding property is updated with the new or modified 
value. A recursive function is executed at step 132 to update 
the anchor partners, described later in more detail. The 
representation of the graphical object is updated on the 
display screen at step 134 to reflect the most recent change. 

Referring now to FIG. 11, a graphical user interface 140 
of a preferred embodiment is provided. The interface 140 is 
generated by the container application 24 on the display 
screen 39 previously described. The interface 140 incorpo- 
rates the interface for the MS VBA 50 and accordingly has 
a similar look and feel. However, the interface 140 includes 
its own menus, toolbars, and other user interface compo- 
nents and functionality as will be described below. 

The interface 140 illustrated in FIG. 11 includes a toolbar 
142, a document or page window 144, a toolbox window 
146, a properties window 148, a project explorer window 
149, and library window 150. The toolbox window 146 
displays icons 152 that represent types of objects that a user 
can place on the page window 144. These objects include 
ActiveX controls 48 (FIG. 2) and those of the RSTools 
program which was developed and is sold by Allen-Bradley 
Company, LLC, the assignee of the subject patent applica- 
tion. 

The properties window 148 displays all the properties for 
a selected object. For example, the properties window 148 
shown in FIG. 11 is displaying the properties 64 for 
Graphicl 154 which is a graphical object 52. The graphical 
representation of Graphicl 154 is displayed on the page 
window 144. In the present exemplary embodiment, 
Graphicl 154 was placed on the page window 144 by first 
opening a graphical object library 156 having a series of 
preformed graphical objects 158 shown within the library 
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window 150. One of the preformed graphical objects 158, 
such as Base 3, was selected by the user and dragged and 
dropped with the pointing device or mouse 36 (FIG. 1) on 
the page window 144 in a desired location or orientation 
indicated by arrow 159. 5 

The project explorer window 149 displays a hierarchical 
list of the currently open projects and its contents. In the 
present example illustrated in FIG. 11, the project explorer 
window 149 displays that the project pertaining to Pagel 
shown on page window 144 includes Graphic! 154 thereon. 10 

With respect to creating graphical objects 52, a user can 
create a graphical object by performing a group function 61 
(FIG. 4), as previously discussed, on an existing shape, 
control, symbol or other graphic. Accordingly, a graphical 
object 52 could be an imported bitmap, symbol or even an 15 
existing control object. As soon as the grouping function is 
applied, it becomes a graphical object 52 and inherits the 
properties, methods and events of that object. Accordingly, 
to perform the grouping function of FIG. 4 using interface 
140 of FIG. 11, the user would select the shapes to be 20 
grouped and then actuate the group function within the 
application menu. Some graphics, such as the preformed 
graphical objects 158 from library 156 previously discussed, 
automatically become a graphical object as soon as they are 
dropped onto the page window 144. Once grouped, the 25 
individual shapes of the graphic object become joined as a 
single object. Accordingly, dragging or otherwise moving 
the graphical object, as later described, will automatically 
move the individual shapes of the graphical object so that the 
graphical object retains its original form with respect to the 
relationships between the individual shapes. 

Referring now to FIG. 12, a second graphical object 52, 
Graphic2 160, has been added to page window 144. In this 
exemplary embodiment, Graphic2 160 was placed on the 35 
page window 144, similar to Graphic! 154, by accessing the 
library 156 and selecting one of said preformed graphical 
objects 158, In this case, object Lwrarm 162, which forms 
the basis of Graphic2 160, was selected by the user from the 
library 156 and dragged and dropped with the pointing 4Q 
device or mouse 36 (FIG. 1) on page window 144 in a 
desired location and orientation relative to the other graphi- 
cal object, Graphicl 154. 

In this particular example, Graphic2 160 is a lower arm of 
a robot device and in the physical sense would be mounted 45 
to pivot about the base, represented here as Graphicl 154. 
Accordingly, Graphic2 is positioned on Graphicl to repre- 
sent the known physical device. Next, the two graphical 
objects must be anchored together. Basically, anchoring 
allows the application to keep the two objects together so 50 
that one object can be moved about another. 

In one preferred embodiment, anchoring involves select- 
ing both objects in an appropriate order to designate which 
object is being anchored to the other. Next, the anchoring 
function is actuated, such as by clicking the anchor icon 164 55 
on the toolbar 142, as shown in FIG. 12. Once clicked, from 
an externally displayed user interface standpoint, the objects 
have been anchored. Internally, the container application 24 
will implement the previously discussed anchor partner 
functionality. Once anchored, an anchor point is created 60 
which designates the pivot point corresponding to how the 
objects will move relative to one another. Referring back to 
FIG. 12, the anchor point between anchored objects 154, 160 
is illustrated graphically as anchor point 166. The anchor 
point 166 belongs to object 160, the object that is anchored 65 
to another, so that anchor point can be changed through the 
properties of that corresponding object, as discussed below. 



In a preferred embodiment, the anchor point can be 
changed at design time or at runtime. At design time, the 
anchor point is changed by changing the value of the 
horizontal distance by the AnchorX property or the value of 
the vertical distance by the AnchorY. The AnchorX and 
AnchorY properties were previously discussed and may be 
modified directly by the user during design time through 
access to the properties window 148 for each respective 
object. Alternatively, by clicking and dragging the anchor 
point 166 with the mouse 36, the AnchorX and AnchorY 
properties can be automatically changed. At runtime, the 
anchor point can be changed by setting the value of the 
AnchorX or AnchorY properties to a numbered value or to 
the value of another property. 

Referring to FIG. 13, an exemplary embodiment of a 
robotic device 168 has been constructed by adding objects 
Graphic3 170 and Graphic4 172 in manner similar to objects 
154, 160 discussed above. In particular, Graphic3 170 has 
been anchored to Graphic2 160 and has an anchor point 174 
corresponding thereto. Graphic4 172 has been anchored to 
Graphic3 170 and has an anchor point 176 corresponding 
thereto. It should be understood that the anchoring of objects 
for movement relative to one another could be applied in 
numerous applications including machines, such as the 
robotic device of this exemplary embodiment, automated 
processes or systems, or any other application where two 
more objects are displayed such that one of the objects 
moves relative to another one of the objects. 

Once the graphical objects have been anchored to one 
another, one can apply the necessary code or use the 
appropriate controls to move one of those objects at runtime. 
For example, a slider tool from the toolbox 146 represented 
by the slider icon 178 (FIG. 13) can be configured to control 
one of said objects. The slider tool per se could be one such 
as the RSSlider tool from the RSTools program previously 
mentioned. The slider tool comprises a slider object, for 
example RSSliderl, the graphical representation of which 
resembles a slider switch. By adding code to RSSliderl, the 
value of the Anchor property of one of the graphical objects 
could be tied to the value between StartValue and EndValue 
properties of the RSSliderl object. Example code for a 
subroutine of RSSliderl to achieve the foregoing is as 
follows: 



Private Sub RSSliderl _Change(ByVal Value As Double, 

GraphicZAnchor - "Value 
End Sub 



Accordingly, during runtime, movement of the graphical 
slider switch by the user with the mouse 36 will change the 
value of the RSSliderl object, which will correspondingly 
change the Anchor property of Graphic2 . Since, as previ- 
ously described, the Anchor property relates to the angle that 
an object can move relative to its anchor point, Graphic2 
will pivot from its anchor point 166 from Graphicl relative 
to the change of the RSSliderl. Further, any other objects 
anchored to Graph ic2 , will move with Graphic2 . However, 
whether these other anchored objects maintain their original 
angle while rotating with its parent object will depend on the 
setting of the AnchorLock property which was previously 
described. While the foregoing illustrates one way to move 
an object, it will be appreciated that using controls from 
RSTools or Visual Basic, for example, one can apply other 
mechanical emulation techniques to these objects. Further, 
the values of the properties of the graphical objects can be 
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tied to other components or even physical objects associated 
with the graphical objects through the server 44 to provide 
real-time mechanical emulation, as previously discussed. 

In the preferred embodiment described above, the rotation 
point of an object can also be changed at design time or at s 
runtime. The rotation point of an object represents the 
location around which an object is rotated. At design time or 
runtime, the rotation point can be changed by changing the 
value of the horizontal distance by the RotationX property or 
the value of the vertical distance by the RotationY property. 10 
These properties were previously discussed and may be 
modified directly by the user during design time through 
access to the properties window 148 for each respective 
object. Alternatively, by clicking and dragging the rotation 
point with the mouse 36, the RotationX and RotationY 15 
properties can be automatically changed. In the exemplary 
embodiment of the robotic device shown in FIG. 13, the 
rotation point of Graphic3 is shown for illustrative purposes 
as point 180. However, it should be appreciated that in this 
embodiment, each object would have a rotation point that 20 
could be graphically represented. At runtime, the rotation 
point can be changed by setting the value of the RotationX 
or RotationY properties to a numbered value or to the value 
of another property. Further, the Rotation property of each 
object may be changed at design time or runtime as similarly 25 
described. 

One can also apply the necessary code or server associa- 
tion to rotate an object at runtime, similar to the Anchor 
controls previously described. As previously described and 
illustrated in FIG. 8, the server 44 can be used to update the 30 
values of graphical object properties. Referring to FIG. 14, 
one preferred embodiment of utilizing the server 44 through 
the user interface 140 is disclosed. FIG. 14 further utilizes 
the exemplary embodiment of the robotic device 168, 
however, it should be understood that the underlining tech- 35 
nique of linking server variables to particular graphical 
objects could be accomplished in a variety of forms and with 
any configuration of graphical objects. 

Interface 140 includes a server window 180 linked to the 
server 44 (FIG. 8). Defined servers are listed in the server 40 
window 180 to facilitate the data linking process by the user. 
In the embodiment of FIG. 14, server window 180 includes 
an excel link 182 having a data address rlcl, which, for 
example, could relate to a particular memory address from 
a remote device such as a PLC. In the illustrated embodi- 45 
ment of interface 140, the data address rlcl can be linked to 
a graphical object by dragging and dropping the data address 
rlcl on the graphical object. In the present example, line 184 
illustrates address rlcl being dragged and dropped with the 
mouse onto Graphic3. Once dropped, a select property 50 
window 186 prompts the user to select the property of the 
object to be linked. In the present example, the Anchor 
property has been selected for illustrative purposes. A prop- 
erty datalink window 188 designates that the Anchor prop- 
erty for Graphicl is linked to rlcl in block 190. In this 55 
present example, Graphic3 is the upper arm of the robotic 
device 168. The angle of Graphic3 from Graphic2 is thereby 
determined by its Anchor property and is displayed in text 
block 192 where Labell is associated with the excel link 
182. 60 

Referring to FIG. 15, a Microsoft Excel application 194 
produced by the Microsoft Corporation of Redmond, 
Washington, has been executed. The excel link 182, shown 
as data link 196 in FIG. 8, is tied to this Excel application 
194, except the Excel application 194 serves as the server 65 
44, illustrated here as DDESERVER 44. Since the Excel 
application 194 uses the DDE, it is being used in this 



exemplary embodiment to illustrate an application of the 
server 44. However, it should be understood, as previously 
described, that the present invention could utilize any one of 
a number of server protocols or applications including 
RSLinx™ OPC™ or other data transmission methods. 
Further, it should be understood that the application and use 
of a server as described herein, such as the DDESERVER 
44, includes any necessary kernel process which manages 
the resources for the server and completes any interprocess 
communication that is necessary. 

During execution of Page 1 from the container application 
24 (FIG. 3), a runtime window 198 is displayed showing the 
graphical objects, which were previously configured and 
anchored, and moving the graphical objects in accordance 
with updates of values of any properties of the objects. In the 
present exemplary embodiment, the Anchor property of 
Graphic3 originally had a value of 0, as shown in block 200 
of FIG. 14. During execution, Labell of the Excel applica- 
tion 194, shown in block 202 of FIG. 15, has been updated 
to a value of 30. Accordingly, through the DDE and data link 
process previously described, the Anchor property of 
Graphic3 has been updated to a value of 30, as also shown 
in the text block 192. Accordingly, Graphic3 has moved 30 
degrees from its original position designated at position 204. 

Since Graphic3 has pivoted from its anchor point 174 
(FIG. 13) with Graphic2 , Graphicl and Graphic2 have 
remained in their original positions. However, where 
Graphic4 is anchored to Graphic3, Graphic4 has moved with 
Graphic3. Since the AnchorLock property of Graphic4 was 
set to true, Graphic4 has maintained its original angled 
relationship with Graphic3 through their connection at 
anchor point 176 (FIG. 13). Since at runtime, the various 
design time graphical representations of anchor points are 
not typically needed, anchor point 176 is represented in FIG. 
15 at position 206 for reference purposes only. If on the other 
hand, the AnchorLock property of Graphic4 had been set to 
false, Graphic4 would have moved with Graphic3 since 
these objects are anchored to one another. However, 
Graphic4 would not have maintained the same angled rela- 
tionship with Graphic3. Instead, Graphic4 would remain in 
a similar orientation represented generally at position 208. 

Through the foregoing example, the mechanical emula- 
tion created by the graphical objects can be appreciated. 
Further, for example, the robotic device 168 could be 
constructed based on a physical robotic device where the 
server would then update the robotic device 168 in accor- 
dance with all movements of the various components of the 
physical robotic device where each of the various compo- 
nents are associated with particular graphical objects of the 
device 168 being represented. Alternatively, since the server 
can both read or write updates, the reader should appreciate 
that the graphical objects could equally be used to control an 
external device or process where the flow of data is simply 
reversed, as illustrated by the dual data flow representation 
of network 42 in FIGS. 1 and 8, to allow the server to write 
data updates across the network to a receiving location. In 
this case, manipulation of the graphical objects will cause 
the changed values of the properties to be sent from the 
server to control the linked components or devices. 
Additionally, in some applications, the container application 
24 may be limited to only displaying the graphical objects in 
a runtime mode where such a display will serve to monitor 
or control the particular application that has been modeled. 

Accordingly, it can be seen that the method for joining 
graphical objects displayed on the graphical window of the 
display screen of the present invention allows movement of 
one of the graphical objects to correspondingly move 
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another one of the graphical objects joined or anchored 
therewith. In the preferred method or system, the computer 
system is operated in an object-oriented environment. First 
and second graphical objects are provided with a represen- 
tation of them being dragged in the graphical window in 5 
response to position commands from a user interface 
coupled with the computer system to position the represen- 
tations in a desired orientation relative to one another. The 
first and second graphical objects are operatively joined or 
anchored at an anchor point. Each graphical object has an 1Q 
anchor property corresponding to the graphical object's 
position relative to its anchor point. 

The method or system of graphically monitoring an 
automated process having a plurality of different types of 
computer-monitored or physical components can be sum- 15 
marized in one preferred embodiment by the following. First 
and second graphical objects are provided and operatively 
connected to one another such that movement of a repre- 
sentation of one of the graphical objects on the display 
screen correspondingly affects the movement of the other 2 q 
representation. Each of the first and second graphical objects 
are associated or linked with one of the plurality of different 
types of computer-monitored components. Data is received 
from the automated process where the data represents posi- 
tion or state changes of the computer-monitored compo- 25 
nents. 

In another embodiment, the graphical objects are selected 
from a library database. Further, the representations of the 
selected objects may have a graphical shape corresponding 
to physical attributes or a general appearance of the 30 
computer-monitored components. Where the system is to 
provide mechanical emulation for user display or control 
purposes, during design time the user will determine a 
relationship between the two computer-monitored compo- 
nents or sub-components thereof based on a physical prox- 35 
imity factor and a physical connection factor. The physical 
proximity factor corresponds to distance or orientation 
between the components or the lapped relationship between. 
The physical connection factor relates to the manner of 
mechanical connection, such as a pivot point. These rela- 40 
tionships may be inherently known by the user, obtained 
from visual or measured inspection of the components by 
the user, or among other ways, obtained from review of the 
component's specifications. Accordingly, once the first and 
second graphical objects have been created or retrieved, 45 
their representations may be graphically displaying on the 
display device with the physical proximity factor being 
represented with the orientation of the representations of the 
first and second graphical objects relative to one another. In 
some cases this may require positioning the graphical 50 
objects in lapped relationship. The physical connection 
factor is represented with positioning and implementing an 
anchor point through the anchoring process, as previously 
discussed, which serves to operatively connect the repre- 
sentations of the first and second graphical objects from that 55 
point, as well as provide a pivot point, if desired. 

The physical components may correspond to actual physi- 
cal components that the user may examine. Alternatively, the 
physical components may relate to known components 
having known relationships with one another or may relate 60 
only exist in a virtual sense in a proposed design to be 
modeled or simulated with graphical objects of the present 
invention. 

Referring back to the previous discussion where data is 
received from the automated process, predetermined prop- 65 
erties of the first and second graphical objects are then 
updated with the data. These properties are predetermined in 



the preferred embodiment by nature of their association in 
the data linking process. The representations of the first and 
second graphical objects are displayed and then moved in 
response to updating the predetermined properties with the 
data as it is received. 

With respect to the use of the term "automated process," 
it should be noted that this term used herein refers to those 
processes or system that are automated with respect to the 
general meaning of the term, as well as those systems that 
are automated through the use of some network or computer 
sharing or distribution of information, but not to say that all 
human observation, effort, or decision making has been 
eliminated. For example, a factory automation process may 
include a conveyor system or production line having a series 
of workstations. A user display for monitoring the factory 
automation process may have being configured in accor- 
dance with the teachings of the present invention where 
components of the process are represented and linked with 
graphical objects. However, the fact that some workstations 
or aspects of the process are not completely automated in the 
system does not prevent the ability of the user display from 
representing some of the process or its state of present 
operation through mechanical emulation of the accessible 
components of the process. 

Although the invention has been described by reference to 
some embodiments it is not intended that the novel device be 
limited thereby, but that modifications thereof are intended 
to be included as falling within the broad scope and spirit of 
the foregoing disclosure, the following claims and the 
appended drawings. 

We claim: 

1. A method for joining graphical objects displayed on a 
graphical window of a display screen of a computer system 
so that movement of one of said graphical objects will 
correspondingly move another one of said graphical objects 
joined therewith, said method comprising: 

operating the computer system in an object-oriented envi- 
ronment; 

providing a server operatively connected with the com- 
puter system and adapted to communicate data across 
a network; 

providing first and second graphical objects; 

dragging a representation of the first graphical object in 
the graphical window in response to position com- 
mands from a user interface coupled with the computer 
system to position the representation of the first graphi- 
cal object in the graphical window in a desired orien- 
tation; 

dragging a representation of the second graphical object 
in the graphical window in response to position com- 
mands from the user interface to position the represen- 
tation of the second graphical object in the graphical 
window in a desired orientation relative to the position 
of the representation of the first graphical object, said 
steps of dragging the representations of the respective 
first and second graphical objects occurring in a design 
state; 

operatively joining said first and second graphical objects 
at an anchor point, wherein one of the graphical objects 
has an anchor property corresponding to the graphical 
object's position relative to the anchor point; 

communicating across the network with the server to 
automatically, without user interaction, receive data 
from an automated component where such data corre- 
sponds to a position change of one said graphical 
objects; and 
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moving one of said graphical objects in response to its 
receipt during a runtime state of said data correspond- 
ing to a position change and correspondingly moving 
another one of said graphical objects joined therewith. 

2. The method of claim 1, wherein each of the first and 
second graphical objects has a rotation point and a rotation 
property, the rotation property corresponding to the graphi- 
cal object's rotational position relative to the rotation point. 

3. The method of claim 2, wherein the rotation property 
has a value in the range of 0-360 degrees. 

4. The method of claim 1, wherein the anchor property has 
a value in the range of 0-360 degrees. 

5. The method of claim 2, wherein the rotation point and 
anchor point are adjustable by a user during design time and 
run time. 15 

6. The method of claim 2, wherein said one of the first and 
second graphical objects has an anchorX and anchorY 
property, the anchorX property corresponding to a horizon- 
tal position component of the anchor point, and the anchorY 
property corresponding to a vertical position component of 20 
the anchor point, 

7. A method of operatively joining graphical objects 
graphically displayed on a computer display device of a 
computer system which includes the computer display 
device, a processor, and memory, the method comprising: 

providing first and second graphical objects and storing 
the graphical objects in the memory of the computer 
system; 

joining the first and second graphical objects to one 
another such that movement of a representation of one 
of said first and second graphical objects on the display 
device correspondingly affects the movement of a 
representation of another one of said first and second 
graphical objects; and 

moving the representation of one of the first and second 
graphical objects on the display device in response to a 
value change of a property of said one of the first and 
second graphical objects, the value change of the 
property being automatically, without user interaction, 
communicated from an automated component across a 
network and received by the computer system, the 
property being associated with positioning of the rep- 
resentation of said one of the first and second graphical 
objects on the display screen, and automatically mov- 
ing the representation of the other one of the first and 
second graphical objects joined therewith so that the 
representations of the first and second graphical objects 
emulate a mechanical connection of the representa- 
tions. 

8. The method of claim 7, wherein one of the graphical 
objects includes an anchor property, a value of the anchor 
property corresponding to the relative pivotal position of 
said one of the graphical objects to an anchor point of said 
one of the graphical objects associated with the joining of 
the graphical objects to one another. 

9. A method of operatively joining two or more graphical 
objects graphically displayed on a computer display device 
of a computer system which includes the computer display 
device, a processor, and memory, the method comprising the 
steps of: 

determining a relationship between two physical compo- 
nents based on a physical proximity factor and a 
physical connection factor; 

providing first and second graphical objects in an object- 
oriented environment and storing the graphical objects 
in the memory of the computer system; 
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graphically display representation of the first and second 
graphical objects on the display device; 

enabling a user to adjust the orientation of the represen- 
tation of the first and second graphical objects relative 
to one another during a design state by operating a 
pointer device operatively connected to the computer 
system so that the orientation of the representations of 
the first and second graphical objects graphically rep- 
resents the physical proximity factor; 

enabling a user to selectively position an anchor point of 
one of the first and second graphical objects onthe 
display device by operating a pointer device so that the 
anchor point graphically corresponds to the physical 
connection factor of the two physical components 
relative to the representations of the first and second 
graphical objects; 

effectuating a change of value in properties of said one of 
the first and second graphical objects that represent the 
position of the anchor point relative to the representa- 
tion of said one of the first and second graphical objects 
based on the selected position of the anchor point by the 
user; 

communicating data across a network connected with the 
computer system via a server automatically, without 
user interaction, to receive data from an automated 
component where such data corresponds to a position 
change of one of said graphical objects; and 

moving one of said graphical objects during a runtime 
state in response to its receipt of said data correspond- 
ing to a position change and correspondingly moving 
another one of said graphical objects through its pivotal 
connection through the anchor point. 

10. The method of claim 9, wherein said one of the first 
and second graphical objects includes an anchor property, a 
value of the anchor property corresponding to the relative 
pivotal position of said graphical object on its anchor point. 

11. The method of claim 10, wherein the value of the 
anchor property is in the range of 0 to 360 degrees. 

12. The method of claim 9, wherein the first and second 
graphical objects are each comprised of a plurality of other 
similarly configured graphical objects operatively connected 
together. 

13. The method of claim 9, wherein the first and second 
graphical objects are each comprised of a plurality of other 
similarly configured graphical objects operatively connected 
together. 

14. A computer system, comprising: 
a computer having a process; 

a memory operatively coupled to the computer; 

first and second graphical objects stored within the 
memory of the computer, the first and second graphical 
objects having at least one property corresponding to 
the position of a representation of the respective graphi- 
cal object; 

the first and second graphical objects being anchored 
together so that movement of a representation of one of 
the first and second graphical objects correspondingly 
moves a representation of the other one of the first and 
second graphical objects as either of the first and 
second graphical objects receive data automatically, 
without user interaction, across a network from a 
remote automated component that updates during runt- 
ime a value of the property from the data corresponding 
to the position of such graphical object; and 

a display screen, operatively coupled to the memory, for 
graphically displaying the representations of the first 
and second graphical objects. 
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15. The computer system of claim 14, wherein the first 
and second graphical objects have an anchor point corre- 
sponding to a graphical connection between the representa- 
tions of the first and second graphical objects. 

16. The computer system of claim 15, further comprising: S 
a user interface, operative ly coupled to the display screen, 

for dragging, in response to commands issued by the 
user, the graphically displayed representations of the 
graphical objects, and for dropping, in response to 
commands issued by the user, the graphically displayed 10 
representations of the graphical objects in a desired 
orientation relative to one another and for dragging, in 
response to commands issued by the user, the anchor 
point of the graphical objects, and for dropping, in 
response to commands issued by the user, the anchor 15 
point in a desired position to graphically represent the 
position of the connection between the representations 
of the graphical objects; and 
means, operatively coupled to the memory, in response to 
commands issued by the user from said user interface, 20 
for altering a value of an anchor position property of 
one of said pair of graphical objects corresponding to 
the desired position of the anchor point. 

17. A method for joining graphical objects displayed on a 
graphical window of a display screen of a computer system 25 
so that movement of one of said graphical objects will 
correspondingly move another one of said graphical objects 
joined therewith, said method comprising the steps of: 

providing first and second graphical objects; 3Q 
dragging a representation of the first graphical object in 
the graphical window in response to position com- 
mands from a user interface coupled with the computer 
system to position the representation of the first graphi- 
cal object in the graphical window in a desired orien- 35 
tation; 

dragging a representation of the second graphical object 
in the graphical window in response to position com- 
mands from the user interface to position the represen- 
tation of the second graphical object in the graphical 40 
window in a desired orientation relative to the position 
of the representation of the first graphical object, said 
steps of dragging the representations of the respective 
first and second graphical objects occurring in a design 
state; 45 

operatively joining said first and second graphical objects 
to one another; 



automatically, without user interaction, receiving data 
communicated across a network to the computer sys- 
tem from an automated component during a runtime 
state to update a position property value of one of the 
graphical objects, the data corresponding to a position 
change of one of the first and second graphical objects; 
and 

moving one of the first and second graphical objects based 
on the received data and updated position property 
value and correspondingly moving another one of the 
first and second graphical objects joined therewith. 

18. A computer system, comprising: 
a computer having a processor; 

a memory operatively coupled to the computer; 

first and second graphical objects stored within the 
memory of the computer, the first and second graphical 
objects having at least one property corresponding to 
the position of a representation of the respective graphi- 
cal object, 

the first and second graphical objects operatively con- 
nected together so that movement of a representation of 
one of the first and second graphical objects corre- 
spondingly moves a representation of the other one of 
the first and second graphical objects as one of the first 
and second graphical objects automatically, without 
user interaction, receive data communicated across a 
network from an automated component connected to 
the network for updating during runtime a value of the 
property from the data corresponding to the position of 
such graphical object; and 

a display screen, connected to the computer, for graphi- 
cally displaying the representations of the first and 
second graphical objects. 

19. The computer system of claim 18, wherein the first 
and second graphical objects reside within a container 
application operating with the computer and data received 
from the network is received via server operatively con- 
nected with the container application. 

20. The computer system of claim 19, wherein the server 
operates independently from the container application to 
maintain communication with the network and to facilitate 
the automatic updating of any changed values of properties 
of the graphical objects. 
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